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BACKGROUND OF THE INVENTION 

The present invention relates generally to forward error 
correction systems, and in particular to forward error correction 
systems using iteratively decoded codes. 

Electronic communication channels provide for the 
transmission of large quantities of information. Communication 
channels, however, tend to be noisy. The noise inherit in a 
communication channel tends to produce errors in the transmitted 
information. Accordingly, redundant information is often 
included in transmitted data, with the redundant information 
y allowing a receiver to reconstruct the transmitted message, 

j;: 15 A large number of coding schemes exist for determining the 

^ amount and nature of the redundant information included in 

[si transmitted data. The coding schemes tend to vary somewhat in 

2 terms of the number of error bits determinable for a given number 

n of information bits and number of redundant bits, the ability to 

T\i 20 locate the error bits, the ability to correct burst errors, and 
other various characteristics. In addition, for any particular 
coding scheme there tend to be a number of codes available with 
the codes often varying in terms of the number of information 
bits and the number of redundant bits. Further, codes may be 
25 systematic, with redundant bits added to, for example, the end 
of a stream of information bits, or non- systematic, with the 
information bits and the redundant bits combined in various ways 
to form a transmitted bit stream. 

Coding schemes and actual codes are often selected for use 
based on various criteria. These criteria include the expected 
bit error rate (BER) of the transmission system, the desired BER, 
the amount of transmission overhead associated with a particular 
code, and the amount of processing necessary to process the code. 

Processing of the code generally entails forming code 
symbols out of information symbols prior to transmission, and 
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determining the information symbols from received versions of the 
code symbols, i.e. received symbols, upon reception. Forming of 
code symbols is often termed encoding, and determining the 
information symbols from received symbols is often termed 
decoding. Different codes have different processing requirements 
for encoding and for decoding. 

One type of codes are low density parity check codes. Low 
density parity check codes are discussed, for example, in R.G. 
Gallager, Low Density Parity Check Codes, IRE Trans. Info. 
Theory, IR-8:21-28 (Jan. 1962), the disclosure of which is 
incorporated by reference. Generally, low density parity check 
codes are parity check codes with a parity check matrix 
containing mostly zeroes. Somewhat specifically, the parity check 
J 15 matrix may be defined in terms of block length N, the number of 
=p ones per column j , and the number of ones per row k (N,j,k) . The 

ones in the parity check matrix are preferably randomly 
distributed within the matrix. 

A parity check matrix may be formed by first generating a 
ffj 20 submatrix having only a single one per column, and then randomly 
permutating the columns of the submatrix to form additional 
submatrices until the entire parity check matrix is formed. Thus, 
for any (j,k) code a number of parity check matrices of varying, 
or possibly the same, block lengths may be formed. 
2b An example parity check matrix is provided as Fig. 1. The 

parity check matrix, sometimes referred to as H, is for a (3,4) 
regular low density parity check (LDPC) code. The parity check 
matrix has a block length n of 12 . As illustrated the parity 
check matrix has three ones per column and four ones per row. 
30 The parity check matrix is used for code words 12 of symbols 
based on information words of 3 symbols. 

Parity check matrices for LDPC codes are often discussed 
with respect to their associated bipartite graph. A bipartite 
graph, at least in this context, includes a number of variable 
3r nodes and a number of check nodes. The variable nodes are 



w 

5 

3 s 
=3;: 

i 



-2- 



40705/DMC/V165 



arranged in a first line and the check nodes are arranged in a 
second line. The number of variable nodes is the same as the 
number of symbols in the code word. The number of check nodes is 
equal to the number of constraints, or checks, placed on the 
variable nodes. Lines, sometimes referred to as edges, connect 
the variable nodes and the check nodes, and indicate which checks 
apply to which variables. 

A bipartite graph for the parity check matrix of Fig. 1 is 
shown in Fig. 2. The graph includes 12 variable nodes and 9 check 
nodes. Each of the variable nodes 21 is connected by lines 2 5 to 
three check nodes, indicating that each variable has three parity 
checks. Each of the check nodes 23 is connected by lines to four 
variable nodes, indicating that each check is part of parity 
checks for four variables. 

Decoding may. be accomplished using a variety of methods, 
including using the parity check directly to determine error 
symbols. More generally, however, error correction capability may 
be increased using iterative decoding methods such as the sum- 
product algorithm, or through use of what is sometimes more 
generally referred to as belief propagation. The sum product 
algorithm is described more fully, for example, in N. Wiberg, 
Codes and Decoding on General Graphs, Linkoping Studies in 
Science and Technology, Dissertations No. 44 0 (Linkoping 
University, 1996) , the disclosure of which is incorporated by 
reference. In short, in these methods probabilities of symbol 
values are determined and assigned to variables, and then 
redetermined and assigned multiple times. 

SUMMARY OF THE INVENTION 

The present invention therefore provides a forward error 
correction system including a linked iteratively decoded code. 
In one embodiment the invention comprises a method of forming 
sets of code symbols out of a series of sets of code symbols for 
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use in a systematic iteratively decoded code. In a method 
comprises forming a first set of code symbols by forming a number 
of code symbols from a first set of data symbols and forming a 
5 second number of code symbols using the first set of data symbols 
and the previously formed code symbols. At least some of the 
second number of code symbols are formed using code symbols using 
a previously formed set of code symbols. In a further embodiment 
the method further comprises forming a second set of code 
10 symbols. The second set of code symbols are formed by forming 
a further second number of code symbols from a second set of data 
symbols and forming further second member of code symbols using 
the second set of data symbols and previously formed code 
symbols. At least some of the further second member of code 
symbols are formed using at least some of the second member of 
code symbols. 

H' In a further embodiment of the invention, the invention 

comprises a method of forming code bits for use in a system 
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M: employing a linked low density priority check code. The method 

0 20 comprises receiving a data stream comprising data bits d x . . .d 1A , 
J d 2 . . .d 2a . . .d y . . .dy a . . .d x . . .d xa . . . . The method further comprises 

p forming a code stream comprising code bits c x . . .c 1A . . .c 1B , 

c 2 • • • c 2a • • • c 2 b . . . Cy . . . Cy a , Cy a+ i . . • Cyb . . . c x . . . c xa , c xa+ i . . . Cb e .... where 
c x . . .c xa are d x . . .d xa . At least some of the bits c xa+1 . . . c^ are an 
XOR combination of prior bits including at least some of the bits 

Cya+l ■ • * Cyb • 

A further embodiment of the invention provides a forward 
error correction system. The forward error correction system 
uses iteratively decoded codes. The system comprises an encoder. 
The encoder encodes information symbols to form code symbols. 
The code symbols are comprises of sets of code symbols, a current 
set of code symbols comprising a number of code symbols formed 
of information symbols and a number of code symbols formed using 
information symbols, code symbols with a previous set of code 
symbols, and previously formed code symbols of a current set of 
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code symbols. The system further comprises a decoder, the 

decoder iteratively decoding the code symbols. In a further 

embodiment of the invention the code symbols are formed using an 

XOR operation. In one embodiment the XOR operation is 

accomplished in accordance with a linked low density priority 

check code. In a further embodiment the linked LDPC code is 

formed by extending a portion of an original LDPC matrix. In one 

embodiment the portion of the original LDPC matrix comprises a 

base portion, an upper extending portion, and a sideways 

extending portion. 

These and other aspects of the present invention will be 

y.. more fully appreciated upon examination of the following drawings 

W and detailed description. 

Q 15 

-P BRIEF DESCRIPTION OF THE DRAWINGS 

P Fig. 1 illustrates a low density parity check matrix, 

yj Fig. 2 is a bipartite graph associated with the parity check 

matrix of Fig . 1 . 

Fig. 3 illustrates a transmission system in accordance with 
the present invention. 

Fig. 4 is a parity check matrix in accordance with aspects 
of the present invention. 

Fig. 5 illustrates use of the parity check matrix of Fig. 

4 . 

Fig. 6 illustrates a band matrix forming a parity check 
matrix in accordance with aspects of the present invention. 

Fig. 7 is a bipartite graph associated with a parity check 
accomplished for the data transmission format of Fig. 4 of an 
encoding operation in accordance with the present invention. 
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DETAILED DESCRIPTION 

Fig. 3 illustrates a data transmission system in accordance 
with the present invention. A data stream comprising information 
35 words is provided to an encoder 15. The encoder forms code words 
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using the information words. The encoder provides the code words 
to a transmitting unit 17. The transmitting unit transmits the 
code words over a transmission media 18. In one embodiment, the 
transmission media is a fiberoptic line and the code words are 
transmitted serially over the fiberoptic line. In another 
embodiment, the transmitting unit is an RF transmitter and the 
code words are transmitted through space. 

After the code words are passed through the transmission 
media, the code words are received by a receiving unit 19. Upon 
receipt by the receiving unit the code words are provided to a 
decoder 20. The decoder decodes and corrects the received signal, 
thereby extracting the information signal. 

The present invention uses, in one embodiment, a linked LDPC 
code. Aspects of the linked LDPC code may be understood with 
r 15 respect to Fig. 4. Fig. 4 illustrates a parity check matrix 41 
j;; in accordance with aspects of the present invention. Preferably, 

4» the parity check matrix is a low density parity check matrix with 

the matrix primarily comprised of zeros, with ones sparsely 
populating the matrix. For purposes of example, however, the 
H ! parity check matrix of Fig. 4 has a relatively heavy weighting 

2. of ones . 

jj As illustrated, a portion 43 of the matrix is extended. The 

Q extended portion may be viewed as originating approximate a lower 

left corner 45 of an original matrix 47, and being placed above 
approximate an upper left corner 4 9 of the original matrix. The 
2 5 extended portion is formed of a number of matrix elements below 
a psuedo-diagonal 51 of the matrix. The psuedo- diagonal 
delineates a series of blockwise elements 53a, b,c, about the 
lower left corner of the matrix. Thus, the original matrix of 
Fig. 4 is an 8 x 6 matrix. The extended portion includes a first 
block 53a comprised of the elements (5,1), (5,2), (6,1), and 
(6,2). A second block 53b is formed of elements (7,1), (7,2), 
(8,1), and (8,2). A third block 53c is formed of elements (7,3), 
(7,4), (8,3), and (8,4). The second element therefore forms a 
base block in the lower left corner of the original matrix. The 
first block is an upward extending block extending upward from 
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the base block. The third block is a sideways extending block 
extending sideways into the original matrix from the base block. 

In operation, the extended portion pertains to, and is 
correlated with, previously transmitted data. The main portion 
of the matrix pertains to, and is correlated with, subsequently 
transmitted data. The subsequently transmitted data, therefore, 
is linked with the previously transmitted data. 

Decoding using the parity check matrix of Fig. 4 may be 
described with respect to Fig. 5. Fig. 5 illustrates parity 
checks using the parity check matrix of Fig. 4 on a received 
transmitted data stream. The received transmitted data stream 
includes a series of sets 61a, n of transmitted code words 
resulting in received words. Each set of transmitted code words 
has two data bits 63a, b and six parity check bits 65c-f . Each 
O 15 of the bits of the received word have three parity checks 67, and 
each of the parity checks uses four bits 69. The code, 
X therefore, is a (3,4) code. 

M: Using a set of data and parity bits from an approximate mid- 

W point of a transmission stream as an example, it may be seen that 

parity checks utilize parity bits from a previously transmitted 
set in the series of sets. For example, a first parity check 71 
ni uses bits from an nth received set 61n and bits from an n-1 

received set 61n-l. Similarly, some of the parity bits from the 
current series are used in parity checks for subsequently 
transmitted series. For example, a second parity check 73 uses 
25 bits from the nth received word and from an n+1 received word. 

As illustrated in Fig. 5, the two data bits do not include 
parity checks from a removed portion 75 of the parity check 
matrix. Instead, a portion of the removed portion is extended 
from operation on a prior set. This extended portion 77 is used 
to generate parity check bits used for checking data bits. 
Similarly, some of the parity check bits also have parity checks 
performed on them using portions of the extended matrix. 
Finally, a portion of the parity bits are used for checks in 
subsequent sequences . 

Thus, in one embodiment, transmitted bits other than a first 
3 5 set of data bits have parity checks which depend on previously 
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transmitted bits. Similarly, transmitted bits are included in 
parity checks utilizing subsequently transmitted bits. In other 
words, transmitted data is decoded in a substantially non- 
segmented manner with subsequent decoding able to be used to 
correct errors in previously transmitted bits. 

Alternatively, the parity checks of Fig. 5 may be viewed as 
similar to a large band matrix. Such a band matrix is shown in 
Fig. 6. The band matrix has a number of rows 91 equal to the 
number of transmitted bits in the data stream. The number of 
columns 93 is dependent on the order of the code used to generate 
the transmitted bits, and the number of transmitted bits. Within 
the band the values of the matrix repeat on a periodic basis, the 
period being related to the size of the code. The periodicity 
of the elements of the band are useful in allowing for the use 
of repeating algorithms in decoding. 

The width 95 of the band matrix bounds the number of bits 
used in parity checks for any particular bit. The width of the 
band therefore also bounds the number of bits used to encode the 
information words during encoding. As illustrated, the width of 
the band is always greater than one, that is does not reduce at 
of any point to merely the diagonal elements of the matrix. 
However, the width of the band is also not uniform. Instead, the 
width of the band varies along with the periodic basis of the 
repeating values of the matrix. 

A code ' in accordance with the present invention may 
therefore be considered a repeating infinite length low density 
band matrix parity check code. The code is repeating in that the 
parity checks are repeating in nature. 

The effective length of the code may also be understood with 
reference to Fig. 7. As illustrated in Fig. 7 the bipartite 
graph includes a sequence of variable nodes 101 and a sequence 
of check nodes 103. The sequence of variable nodes is as long as 
the number of bits in the transmitted code words 103a... n. When 
viewing the bipartite graph of Fig. 7, it may be seen that the 
relationship between check nodes and variable nodes is such that 
changes in value of a variable unassociated with a specific code 
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word may result in correction of a variable associated with some 
other code word anywhere in a sequence of code words. 

Moreover, use of a system in accordance with Fig. 7 does not 
unduly increase the time and space necessary to perform encoding 
operations. As the previous discussion indicates, the code is 
systematic and the data bits form part of the code word. The 
parity bits are determined so as to fullfill the appropriate 
parity check equations determined by the parity check matrix. 
As all parity checks are to be satisfied, each parity check bit 
can be determined using any of the parity check equations. 
Conveniently, each parity check bit is used in a parity check 
otherwise made up of previous data bits and previous parity bits. 

Accordingly, each parity bit in one embodiment, is 
determined by XORing the appropriate previously known or 
5! 15 determined bits. For example, information bits are provided to 
4:; the encoded of Fig. 3. The information bits are part of a stream 

4 ;; of information bits, and are used to form code bits. Previously 

formed code bits are also used in forming the code bits. The 
hi information bits themselves form code bits as the code is a 

3 systematic code. Successive code bits are then formed using 

JT 20 previously formed code bits. The data bits and the successive 
W\ code bits form a set of code bits. The previously formed code 

*p bits comprise the code bits formed of the dat bits and code bits 

W from the previous set of code bits. The process continues in 

this fashion the length of the stream of information bits. 
25 Using the code of Fig. 5 as an example, the code bits 

include a set of code bits 61n. The first two code bits 68a, b 
are formed of information bits. The third code bit 70a is formed 
by selectively XORing the data bits and code bits from a previous 
set of code bits 61n-l. For example, a sixth code bit 70d is 
formed by selectively XORing code bits from the previous set of 
code bits, the data bits, and already calculated code bits from 
the current set of code bits. 

The present invention therefore provides a forward error 
correction system method. Although the invention has been 
described with respect to certain specific embodiments, it should 
35 be recognized that those skilled in the art would recognize how 
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to implement the invention within substantial changes. Thus, the 
present embodiments should be considered exemplary only, with the 
invention being defined by the claims and their equivalents 
supported by this disclosure. 



